Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add release workflow for ml-models #77

Merged
merged 1 commit into from
Feb 10, 2023

Conversation

gaiksaya
Copy link
Member

@gaiksaya gaiksaya commented Feb 10, 2023

Signed-off-by: Sayali Gaikawad [email protected]

Description

Adds jenkins file to semi-automate publishing ml-models to artifacts.opensearch.org.
Currently the workflow needs to be run manually for each model as there is no trigger or automation set at source. Once the automation is in place we can maybe connect the 2 workflows.

Dependent PR: opensearch-project/opensearch-build-libraries#137

Issues Resolved

opensearch-project/opensearch-build#2676

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Sayali Gaikawad <[email protected]>
@gaiksaya gaiksaya marked this pull request as ready for review February 10, 2023 19:56
description: 'S3 base path to download artifacts from eg:ml-models/huggingface/sentence-transformers/all-distilroberta-v1. DO NOT include the trailing backlash at the end',
trim: true
)
string(
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

After version, there are also two types of folder: torch_script & onnx
will that be any issue? As I'm seeing there are two parameters?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The entire version folder is downloaded along with sub-folders. So this will include above mentioned scripts.

@gaiksaya gaiksaya merged commit 353a473 into opensearch-project:main Feb 10, 2023
@gaiksaya gaiksaya deleted the ml-model-jenkins branch February 10, 2023 21:01
gaiksaya added a commit that referenced this pull request Feb 10, 2023
Signed-off-by: Sayali Gaikawad <[email protected]>
(cherry picked from commit 353a473)
Signed-off-by: Sayali Gaikawad <[email protected]>
gaiksaya added a commit that referenced this pull request Feb 10, 2023
Signed-off-by: Sayali Gaikawad <[email protected]>
(cherry picked from commit 353a473)
Signed-off-by: Sayali Gaikawad <[email protected]>
dhrubo-os pushed a commit that referenced this pull request Feb 14, 2023
(cherry picked from commit 353a473)

Signed-off-by: Sayali Gaikawad <[email protected]>
Co-authored-by: Sayali Gaikawad <[email protected]>
dhrubo-os pushed a commit that referenced this pull request Feb 14, 2023
(cherry picked from commit 353a473)

Signed-off-by: Sayali Gaikawad <[email protected]>
Co-authored-by: Sayali Gaikawad <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants